Matrix-Lifting Semi-Definite Programming 
for Decoding in Multiple Antenna Systems 

r^- ■ Amin Mobasher and Amir K. Khandani 

O " 
O 
<N 

Abstract 

This paper presents a computationally efficient decoder for multiple antenna systems. The 
proposed algorithm can be used for any constellation (QAM or PSK) and any labeling method. 
The decoder is based on matrix-lifting Semi-Definite Programming (SDP). The strength of 
the proposed method lies in a new relaxation algorithm applied to the method of [1]. This 
results in a reduction of the number of variables from (NK + l) 2 to (2N + K) 2 , where N is 
the number of antennas and K is the number of constellation points in each real dimension. 
Since the computational complexity of solving SDP is a polynomial function of the number of 
variables, we have a significant complexity reduction. Moreover, the proposed method offers 
a better performance as compared to the best quasi-maximum likelihood decoding methods 
reported in the literature. 

I. Introduction 

The problem of Maximum Likelihood (ML) decoding in Multi-Input Multi-Output 
(MIMO) wireless systems is known to be NP-hard. A variety of sub-optimum polynomial 
time algorithms based on Semi-Definite Programming (SDP) are suggested for MIMO 
decoding [l]-[9]. The first quasi ML decoding methods based on SDP were introduced 
for PSK signalling [2]-[5], offering a near ML performance and a polynomial time worst 
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case complexity. Subsequently, SDP methods were used for decoding of MIMO systems 
based on QAM constellation [1], [6]. 

The method presented in [6] is for MIMO systems using 16-QAM, where the 
structure of constellation is captured by a polynomial constraint. Then, by introducing 
some slack variables, the constraints are expressed in terms of quadratic polynomials. 
This method can be generalized for larger constellations at the cost of defining more 
slack variables, increasing the complexity, and significantly decreasing the performance. 
The method proposed in [7] is a further relaxation of [6], only utilizing upper and lower 
bounds on the symbol energy in the relaxation step. There is a very slight degradation in 
performance compared to [6]; however, its computational complexity is independent of 
the constellation size for any uniform QAM (order of complexity is cubic). The method 
in [8] is a further tightening of [7] by appending some inequality conditions that are 
implicit in the alphabet constraint. Its computational complexity is still less than [6]. 

In [1], an efficient approximate ML decoder for MIMO systems is developed based 
on vector lifting SDP. The transmitted vector is expanded as a linear combination (with 
zero-one coefficients) of all the possible constellation points in each dimension. Using 
this formulation, the distance minimization in Euclidean space is expressed in terms 
of a binary quadratic minimization problem. The minimization of this problem is over 
the set of all binary rank-one matrices with column sums equal to one. Although the 
algorithm in [1] is a sub-optimal decoding method, it is shown that by adding several 
extra constraints, it can approach the ML performance. However, implementing the extra 
constraints increases the computational complexity. 

In this paper, we introduce a new algorithm based on matrix-lifting SDP [10], [11] 
for any constellation (QAM or PSK) and any labeling method. This algorithm is inspired 
by the method in [1] with an efficient implementation resulting in a better performance 
and lower computational complexity. In SDP optimization problems, the computational 
complexity is a polynomial function of the number of variables. Using the proposed 
method, the number of variables in [1] is decreased from (NK + l) 2 to (2N + K) 2 , 
where N is the number of antennas and K is the number of constellation points in each 
real dimension. In addition to this large reduction in the complexity, simulation results 
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show that the proposed algorithm also outperforms all other known convex quasi-ML 
decoding methods, e.g. [6]-[8]. 

Following notations are used in the sequel. The space of N x K (resp. N x N) real 
matrices is denoted by Mnxk (resp. Mn), and the space of N x N symmetric matrices 
is denoted by S N . For aiVxK matrix X e Mnxk, the (i,j)th element is represented 
by Xij, where 1 < i < N, 1 < j < K, i.e. X = [x^-]. We use trace(A) to denote 
the trace of a square matrix A. The space of symmetric matrices is considered with the 
trace inner product (A, B) = trace(AB). For A, B e Sn, A y (resp. A y 0) denotes 
positive semi-definiteness (resp. positive definiteness), and A y B denotes A — B y 0. 
For two matrices A, B e A4n, A > B, (A > B) means > bij, (a^- > 6^ ) for all i, j. 
The Kronecker product of two matrices A and B is denoted by A®B. For X e -Matxa:, 
vec(X) denotes the vector in M NK (real A^-dimensional space) that is formed from the 
columns of the matrix X. For X e A4 at, diag(X) is a vector of the diagonal elements 
of X. We use e N e R N (resp. N e R N ) to denote the N x 1 vector of all ones (resp. all 
zeros), ~E NxK e A^atx^ to denote the matrix of all ones, and Ijv to denote the N x N 
Identity matrix. For X e Mnxk, the notation X(l : i, 1 : j), i < K and j < N denotes 
the sub-matrix of X containing the first i rows and the first j columns. 

The rest of the paper is organized as follows. The problem formulation is introduced 
in Section II. Section III is the review of the vector-lifting semi-definite programming 
presented in [1]. In Section IV, we propose our new algorithm based on matrix-lifting 
semi-definite programming. We use the geometry of the relaxation to find a projected 
relaxation which has a better performance. In Section V, we present an optimization 
method, based on matrix nearness to find the integer solution of the original decoding 
problem from the relaxed optimization problem. Finally, Section VI conclude the paper 
with some simulation results. 

II. Problem Formulation 
A MIMO system with M transmit antennas and N receive antennas can be modeled 

by 



y = Hx + n, 



(1) 
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where M = 2M, N = 2N, y is the M x 1 received vector, H is M x N real channel 
matrix, n is N x 1 additive white Gaussian noise vector, and x is N x 1 data vector whose 
components are selected from the set • • • , s K }, see [1]. Noting x { e {si, • • • , s K }, 
for i — 1, • • • , N, we have 



Xi = UnSi + u it2 s 2 H h u itK s K , 



where 



Let 



K 



U 



,j e {0, 1} and ^Uij = 1, \/ i = 1, 

3=1 



N. 



(2) 



(3) 
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Ul,l 

u 2 ,i 



Ul,K 
U 2 ,K 



and s 



SK 



un,i ■ ■ ■ un,k 
Therefore, the transmitted vector is x = Us where Ue^ = e^. 
At the receiver, the ML decoding is given by 

x = arg min ||y — Hx|| 2 , (4) 

xje{si,— ,s K } 

where x is the most likely input vector and y is the received vector. Noting x = Us, 
this problem is equivalent to 



min ||y — HUs|| = 

XJe K =e N 

min s T U T H T HUs - 2y T HUs. 

Ue K =e N 



(5) 



Therefore, the decoding problem can be formulated as 

min s T U T H T HUs - 2y T HUs 

s.t. Ue^ = e^v 

mje {0,1}. (6) 

Let Q = H T H, S = ss T , C = — sy T H, and let £nxk denote the set of all binary 
matrices in Mnxk with row sums equal to one, i.e. 

£NxK = {~UeM NxK : Ue K = e N ,Uij G {0, 1}} . (7) 
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Therefore, the minimization problem © is 

min trace (SU T QU + 2CU) 
s.t. U G £nxk 



(8) 



III. Vector-Lifting Semi-Definite Programming 

In order to solve the optimization problem ©, the authors in [1] proposed a 
quadratic vector optimization solution by defining u = vec(U T ),U G £nxk- By using 
this notation, the objective function is replaced by u T (Q <g> S)u + 2vec(C) T u. Then, the 

quadratic form is linearized using the vector 



1 
u 



i.e. 



Z u 
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1 u T 



1 u 
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u uu 



T 



1 u T 
u X 



(9) 



where X = uu and it is relaxed to X y uu , or equivalently, by the Schur complement, 

u 1 



to the lifted constraint 



1 - T 



y 0. Note that this matrix is selected from the set 



u X 

T := conv {Z u : u = vec(U T ), U G S N xi<} , (10) 

where conv(.) denotes the convex hull of a set. Therefore, the decoding problem using 
vector lifting semi-definite programming can be represented by 

vec(C) T 
vec(C) Q <g> S 

1 u T ^ 
u X 

which can be solved by SDP technique. 

Note that in (fTTI) . the optimization parameter is a matrix in S^k+i, which has 
(NK + l) 2 variables. In the following, we reduce the number of optimization variables 
by exploiting the matrix structure of U. 



trace 
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IV. Matrix-Lifting Semi-Definite Programming 



To keep the matrix U in its original form in ([8]), the idea is to use the constraint 
X = U T U instead of X = uu T . As a result, the relaxation X y uu T is transformed to 

[ In U 1 

X >z U U, or equivalently, by the Schur complement, y 0. This is known 

U X 

as matrix-lifting semi-definite programming. Define the new variable V = US. Since the 
matrix S is symmetric, the objective function in ^ can be represented as the Quadratic 
Matrix Program [11] 
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(12) 
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To linearize W u? we consider the matrix 
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where X, Y, Z E S^- This equality can be relaxed to 
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h o. (17) 



It can be shown that this relaxation is convex in the Lowner partial order and it is 
equivalent to the linear constraint [10] 

I U T V T 
U X Y 
V Y Z 

On the other hand, the feasible set in © is the set of binary matrices in M. nxk with row 
sum equal to one, the set Snxk m ©. By relaxing the rank-one constraint for the matrix 
variable in (fT2l) . we have a tractable SDP problem. The feasible set for the objective 
function in (fT2l) is approximated by 

J~M = conv {Wu | U G Mnxk '■ Ue# = e N , 

^•e{0 ; l},Vz,j;V = US} (18) 
Therefore, the decoding problem can be represented by 

min trace (£W) 

s.t. W G T M . (19) 

Note that the size of matrix W is (2N+K) x (2N+K), compared to (NK+1) x (NK+1) 
in [1]. In SDP optimization problems, the computational complexity is a polynomial 
function of the number of variables (elements of W). By the new implementation of 
([T9l , the number of variables in [1] is decreased from (NK+1) 2 to (2iV + K) 2 , resulting 
in a large reduction in the complexity. 

Although the rank constraint in (TT5T ) is relaxed, we can still consider some additional 
linear constraints to further improve the quality of the solution. These constraints are 
valid for the non-convex rank-constrained decoding problem. However, we force the SDP 
problem to satisfy these constraints. Consider the auxiliary matrix V and the symmetric 
matrices X, Y and Z in matrix W. Since U G £nxk and J^/li u % = 1> ^ ^ s clear that 
diag(X) = ejv- Also, Y represents USU T and Z represents US 2 U T . It is easy to show 
that 



diag(Y) = Udiag(S) and diag(Z) = Udiag(S 2 ). 



(20) 



8 



Moreover, S = ss T (rank-one matrix) and S 2 = (X^iL; s ?)S- Therefore, instead of 
diag(Z) = Udiag(S 2 ), we have a stronger result for Z, i.e. Z = (%2 1=i s?)Y. Therefore, 
we have 



/ 



mm 



s.t. 



trace 



\ 



I U T V T 
U X Y 
V Y Z 

; U>0 



Ue K = e N 
V = US 

diag(X) = e^v 
diag(Y) = Udiag(S) 

Z = (f> 2 )Y 

I U T V T " 
U X Y ^ 
V Y Z 

U,V e M 7V X x,X,Y,Z G Sn 



(21) 



The equation in (|20l) determines the diagonal elements of Y. This property is hidden 
in the special structure of U, i.e. U G £nxk- By using this property, we can even add 
more constraints. The equation Y = USU T implies that = Ski for some k and I. 
Therefore, the value of is between the minimum and the maximum elements of S. 
In addition, it can be easily shown that in communication applications, S, Y, and Z are 
diagonal dominant matrices (since s T e^- = 0). This property can be also used to add more 
constraints to improve the quality of the solution. Our studies show that the improvements 
due to including the above constraints are marginal. Therefore, in the sequel, we focus on 
the form given in (I2TT) with the following consideration. The objective function in © is 
trace (SU T QU + 2CU) which is equivalent to trace (QUSU T + 2UC). Exchanging 
the role of Q and S results in two different formulations. Here, the auxiliary variable V is 
defined as QU. Similarly, the auxiliary variables X, Y, and Z represents U T U, U T QU, 
and U T Q 2 U, respectively. Therefore, it is easy to show that the equivalent minimization 
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problem is 



/ 



mm 



s.t. 



trace 



V 



I U V 

U T X Y 
V T Y Z 



J/ 



y o 



C 

C T |s 
|S 

Ue K = e N ; U > 

V = QU 

diag(X) = U T e^ ; X i5 = i ^ j 

Ye K = U T Qe 7V ; trace(YE^) = trace(QE 7V ) 

Ze K = U T Q 2 eAT ; trace(ZE^) = trace(Q 2 EAr) 
I U V 
U T X Y 
V T Y Z j 

U,V eM NxK ,X,Y,ZeS K , (22) 

where the size of the variable matrix is (2K + N). Note that both (I2TI) and (1221) are 
equivalent, however, depending on the structure of the system (values of N and K), we 
can use the one which offers a smaller number of variables. In the following, we focus 
on (I2TI) . which is a better choice for N < K. 

A. Geometry of the Relaxation 

In this section, we eliminate the constraints defining Ue# = e^v by providing a 
tractable representation of the linear manifold spanned by this constraint. This method 
is called gradient projection or reduced gradient method [12]. The following lemma is 
on the representation of matrices having sum of the elements in each row equal to one. 
This lemma is used in our reduced gradient method. 



Lemma 1: [1] Let G 



I 



K-l 



e M(k-i)xk and F = (E NxK — Ejvx(Jsr-i)G) e 



■M-nxk- A matrix U E A4nxk with the property that the summation of its elements in 
each row is equal to one, i.e. Ue^ = e^, can be written as 

U = F + UG, (23) 
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where U = U(l : N, 1 : (K - 1)). 

Corollary 1: VU G Snxk, 3U G M N x(k-i), Uij £ {0, 1} s.t. U = F + UG, where 
U = U(l : N, 1 : (K — 1)). Note that the summation of each row of U is or 1. 

Consider the minimization problem ©. By substituting (|23l) . the objective function 

is 

trace (SU T QU + 2CU) 
= trace (S(F + UG) T Q(F + UG) + 2C(F + UG)) 
= trace (GSG T U T QU + GSF T QU + QFSG T U T 

+GCU + C T G T U T + 2CF + SF T QF) 
= trace (jCWfj + 2CF + SF t Qf) , (24) 



where 



C 



w 



u 



V 





QFSG T + C T G T 


u T 



GSF Q + GC 




o 
o 



i 



V J 



u UU T UV T 
V vu T VV T 
UGSG T . 



(25) 



Therefore, © can be written as 

min trace ^£W^ 

s.t. U = U(1:N,1:(K-1)); Ue£ N xK 

V = U (GSG T ) (26) 

Using a similar procedure, we can show that (|26l) is equivalent to the following reduced 
matrix-lifting semi-definite programming problem: 
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V = U (GSG T ) 
diag(X) = Ue K -i 
diag(Y) = Udiag (GSG T ) 
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U,V G M Nx(K-l)) X, Y, Z G 5n 
Note that this method can also be applied to the equivalent formulation in (|22 



(27) 



B. Solving the SDP Problem 

The relaxed decoding problems can be solved using Interior-Point Methods (IPMs), 
which are the most common methods for solving SDP problems of moderate sizes with 
polynomial computational complexities [13]. There are a large number of IPM -based 
solvers to handle SDP problems, e.g., DSDP [14], SeDuMi [15], SDPA [16], etc. In our 
numerical experiments, we use SDPA solver. 

In the matrix-lifting SDP optimization problem (I2TI) . the rank-constrained matrix 
W u is relaxed to the positive semi-definite matrix W. Utilizing the rank-constrained 
property of the variable parameter, the relaxed problem (f2TT) can be solved using a non- 
linear method, known as the augmented Lagrangian algorithm. This approach can be 
used for large problem sizes and the complexity can be significantly reduced, while the 
performance degradation is negligible [17]. 
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V. Integer Solution - Matrix Nearness Problem 

Solving the relaxed decoding problems results in the solution U. In general, this 
matrix is not in Snxk- The condition Ue^- = e^r is satisfied. However, the elements 
are between and 1. This matrix has to be converted to a 0-1 matrix by finding a 
matrix in Snxk which is nearest to this matrix. Matrix approximation problems typically 
measure the distance between matrices with a norm. The Frobenius and spectral norms 
are common choices as they are analytically tractable. 

To find the nearest solution in Snxk to U, the solution of the relaxed problem, we 

solve 

min ||U-U|||, (28) 

UG Enxk 

where ||A||| is the Frobenius norm of the matrix A which is defined as ||A||| = 
trace(AA ), and 



||U-U||| = trace ((U - U)(U - U) T ) 

= A/ - 2trace(UU T ) + trace (UU T ). (29) 

The last equality is due to the fact that for any U G Snxk, we have diag(UU T ) = e^, see 
(I2TI) . Therefore, after removing the constants, finding the integer solution is the solution 
of the following problem: 

max trace(UU T ) (30) 

UG Snxk 

Consider the maximization problem 

max trace(UU T ) 
s.t. Ue^ = e^v 

0<U<1, (31) 

where < in the last constraint is element-wise. This problem is a linear programming 
problem with linear constraints and the optimum solution is a corner point meaning that 
the constraints are satisfied with equality at the optimum point. In other words, at the 
optimum point, U G Snxk- Therefore, to find the solution for (1301 ), we can simply solve 
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the linear problem (|3D) . which is strongly polynomial time. To improve this result, the 
randomization algorithms, introduced in [1], can be further applied. 

VI. Simulation Results 

We simulate the proposed matrix lifting method (1271 ) for system with 4 transmit and 
4 receive antennas employing 16-QAM. Fig. Q] shows the performance of the proposed 
method vs. the performance of the vector lifting method in [1] and the previous known 
methods in [6]-[8]. As it can be seen, the proposed method outperforms all other convex 
sub-optimal methods. 



4x4 Multiple Antenna Sysmtems with 16QAM Modulation 

1 0° r :: :: : 




E b /N 

Fig. 1. Performance of the proposed matrix lifting SDP method in a MIMO system with 4 transmit and 4 receive 
antennas employing 16-QAM 

The worst case complexity of the proposed method solved by IPMs is a polynomial 
function of the number of antennas (similar to the analysis in [1]). In the optimization 
problem of (121) . where N < K, the dimension of the matrix variable W is m = O(K) 
and the number of constraints is p = 0(K 2 ). Similar to [1], it can be easily seen that 
a solution to (l27l) can be found in at most 0(K 5 5 ) arithmetic operations (utilizing the 
sparsity of the rank-one constraint matrices), where the computational complexity of 
[1], [6], [8], [7] are 0(N 5 - 5 K 5 - 5 ), 0(N 6 - 5 K 6 - 5 ), 0(K 2 N 4 - 5 + K 3 N 3 - 5 ), and 0(N 3 - 5 ) 
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respectively^. Note that for the equivalent optimization problem (|22|) . where K < N, 
the computational complexity is at most 0(N 5 - 5 ). It must be emphasized that depending 
on values of iV and K, we can implement the optimization problem (l2TT) or (|22|) which 
results in less computational complexity. 

Note that many of the constraints have very simple structures. This property can be 
used to develop an interior-point optimization algorithm fully exploiting the constraint 
structures of the problem, thereby getting complexity order better than that of using a 
general purpose solver such as SeDuMi or SDPA. Moreover, we can further reduce the 
complexity of the proposed method by implementing the augmented Lagrangian method 
[17]. 
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